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Abstract. In 2005 Li et al. gave a (/>-competitive deterministic online algorithm for 
scheduling of packets with agreeable deadlines [12] with a very interesting analysis. This 
is known to be optimal due to a lower bound by Hajek 0. We claim that the algorithm 
by Li et al. can be slightly simplified, while retaining its competitive ratio. Then we 
introduce randomness to the modified algorithm and argue that the competitive ratio 
against oblivious adversary is at most | . Note that this still leaves a gap between the best 
known lower bound of | by Chin et al. [5] for randomized algorithms against oblivious 



1. Introduction 

We consider the problem of buffer management with bounded delay (aka packet sched- 
uling), introduced by Kesselman et al. [11]. It models the behaviour of a single network 
switch. We assume that time is slotted and divided into steps. At the beginning of a time 
step, any number of packets may arrive at a switch and are stored in its buffer. A packet 
has a positive weight and a deadline, which is the number of step right before which the 
packet expires: unless it has already been transmitted, it is removed from the buffer at the 
very beginning of that step and thus can no longer be transmitted. Only one packet can 
be transmitted in a single step. The goal is to maximize the weighted throughput, i.e., the 
total weight of transmitted packets. 

As the process of managing packet queue is inherently a real-time task, we investigate 
the online variant of the problem. This means that the algorithm has to base its decision 
of which packet to transmit solely on the packets which have already arrived at a switch, 
without the knowledge of the future. 
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1.1. Competitive Analysis. 

To measure the performance of an online algorithm, we use a standard notion of com- 
petitive analysis [3], which compares the gain of the algorithm to the gain of the optimal 
solution on the same input sequence. For any algorithm Alg, we denote its gain on the 
input sequence / by Galg{I)] we denote the optimal offline algorithm by Opt. We say that 
a deterministic algorithm Alg is 7^-competitive if on any input sequence /, it holds that 

Galg{I) > ^ • Qopt{I)- 

When analysing the performance of an online algorithm Alg, we view the process as 
a game between Alg and an adversary. The adversary controls the packets' injection into 
the buffer and chooses which of them to send. The goal is then to show that the adversary's 
gain is at most TZ times Alg's gain. 

If the algorithm is randomized, we consider its expected gain, E[^alg(-^)]j where the 
expectation is taken over all possible random choices made by Alg. However, in the ran- 
domized case, the power of the adversary has to be further specified. Following Ben-David 
et al. Il], we distinguish between an oblivious and adaptive- online adversary (called adaptive 
for short). An oblivious adversary has to construct the whole input sequence in advance, 
not knowing the random bits used by an algorithm. The expected gain of Alg is com- 
pared to the gain of the optimal offline solution on I. An adaptive adversary decides packet 
injections upon seeing which packets are transmitted by the algorithm. However, it has 
to provide an answering entity Adv, which creates a solution on-line (in parallel to Alg) 
and cannot change it afterwards. We say that Alg is 7^-competitive against an adaptive 
adversary if for any input sequence I created adaptively and any answering algorithm Adv, 
it holds that E[^alg(-^)] > ^ • E[^ADv(-f)]- We note that Adv is (wlog) deterministic, but 
as Alg is randomized, so is the input sequence /. 

In the literature on online algorithms (see e.g. f^), the definition of the competitive ratio 
sometimes allows an additive constant, i.e., a deterministic algorithm is 7^-competitive if 
there exists a constant a > such that ^alg(-^) ^ ^ " ^opt(-^) — a holds for evry input 
sequence I. An analogous definition applies to randomized case. Our upper bounds hold 
for a = 0. 

1.2. Previous work 

The best known deterministic and randomized algorithms for general instances have 
competitive ratios at most 2\f2 — 1 1.828 [6j and e/(e — 1) 1.582 [3], respectively. 
A recent analysis of the latter algorithm shows that it retains its competitive ratio even 
against adaptive-online adversary [8j. 

The best known lower bounds on competitive ratio against either adversary type use 
rather restricted 2-bounded sequences in which every packet has lifespan (deadline — re- 
lease time) either 1 or 2. The lower bounds in question are 4> ~ 1.618 for deterministic 
algorithms [7J, | for randomized algorithms against adaptive adversary [2], and | for ran- 
domized algorithms against oblivious adversary [5J . All these bounds are tight for 2-bounded 
sequences [HI El H] . 

We restrict ourselves to sequences with agreeable deadlines, in which packets released 
later have deadlines at least as large as those released before (rj < rj implies di < dj). 
These strictly generalize the 2-bounded sequences. Sequences with agreeable deadlines also 
properly contain s-uniform sequences for all s, i.e., sequences in which every packet has 
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lifespan exactly s. An optimal (/^-competitive deterministic algorithm for sequences with 
agreeable deadlines is known [12j. 

Jezabek studied the impact of resource augmentation on the deterministic competitive 
ratio [10\ [9]. It turns out that while allowing the deterministic algorithm to transmit k 
packets in a single step for any constant k cannot make it 1-competitive (compared to the 
single-speed offline optimum) on unrestricted sequences [10], A; = 2 is sufficient for sequences 
with agreeable deadlines [9j. 

1.3. Our contribution 

Motivated by aforementioned results for sequences with agreeable deadlines, we inves- 
tigate randomized algorithms for such instances. We devise a |-competitive randomized 
algorithm against oblivious adversary. The algorithm and its analysis are inspired by those 
by Li et al. [12] for deterministic case. The key insight is as follows. The algorithm MG by 
Li et al. |12j can be simplified by making it always send either e, the heaviest among the 
earliest non-dominated packets, or h, the earliest among the heaviest non-dominated pack- 
ets. We call this algorithm MG', and prove that it remains (/^-competitive. Then we turn it 
into a randomized algorithm RG, simply by making it always transmit e with probability 
^ and h with the remaining probability. The proof of RG's |-competitiveness against 
oblivious adversary follows by similar analysis. 

2. Preliminaries 

We denote the release time, weight, and deadline of a packet j by rj, Wj, and dj, 
respectively. A packet j is pending at step t ii rj < t, it has not yet been transmitted, and 
dj > t. We introduce a linear order < on the packets as follows: i ^ j if either 

di < dj , or 

di = dj and Wi > Wj , or 

di = dj and Wi = Wj and < rj . 

To make < truly linear we assume that in every single step the packets are released one 
after another rather then all at once, e.g. that they have unique fractional release times. 

A schedule is a mapping from time steps to packets to be transmitted in those time 
steps. A schedule is feasible if it is injective and for every time step t the packet that t maps 
to is pending at t. It is convenient to view a feasible schedule S differently, for example as 
the set {S{t) : t > 0}, the sequence 5(1), 5(2), . . ., or a matching in the schedulability graph. 
The schedulability graph is a bipartite graph, one of whose partition classes is the set of 
packets and the other is the set of time steps. Each packet j is connected precisely to each 
of the time steps t such that rj<t< dj by an edge of weight Wj] an example is given in 
Figure (H Observe that optimal offiine schedules correspond to maximum weight matchings 
in the schedulability graph. Thus an optimal offline schedule can be found in polynomial 
time using the classic "Hungarian algorithm", see for example |l3j . One may have to remove 
appropriately chosen time step vertices first, so that the remaining ones match the number 
of packet vertices, though. 

Given any linear order ^ on packets and a (feasible) schedule S, we say that S is 
consistent with ^, or that is a ^-schedule, if for every t the packet S{t) is the minimum 
pending packet with respect to ^. It is fairly easy to observe that if ^ is any earliest deadline 
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timesteps 



packets 




Figure 1. Schedulability graph for packets ji, j2, ■ ■ ■ , j^, whose release 
times and deadhnes are (2,3), (2,4), (3,7), (4,7), (6,7) respectively; we ig- 
nore packet weights in the figure. Packets are represented by discs, time 
steps by squares. 

first, with ties broken in an arbitrary way, then any feasible schedule can be turned to a 
unique ^-schedule by reordering its packets; in particular this applies to 

Recall that the oblivious adversary prepares the whole input sequence in advance and 
cannot alter it later on. Thus its solution is simply the offline optimal schedule for the 
complete sequence. Nevertheless, we still refer to the answering entity Adv rather than 
Opt in our analysis, as it involves altering the set of packets pending for the adversary, 
which may well be viewed as altering the input sequence. Now we introduce two schedules 
that are crucial for our algorithms and our analyzes. 

Definition 2.1. The oblivious schedule at time step t, denoted Ot, is any fixed optimal 
feasible ^-schedule over all the packets pending at step t. For fixed Ot, a packet j pending 
at t is called dominated if j ^ Ot, and non- dominated otherwise. For fixed Ot let e denote 
Ot{t), the ^-minimal of all non-dominated packets, and h denote the ^-minimal of all 
non-dominated maximum- weight packets. 

Note that both the adversary and the algorithm can calculate their oblivious schedules 
at any step, and that these will coincide if their buffers are the same. 

Definition 2.2. For a fixed input sequence, the clairvoyant schedule at time step t, denoted 
Ct, is any fixed optimal feasible schedule over all the packets pending at step t and all the 
packets that will arrive in the future. 

Naturally, the adversary can calculate the clairvoyant schedule, as it knows the fixed 
input sequence, while the algorithm cannot, since it only knows the part of input revealed 
so far. However, the oblivious schedule gives some partial information about the clairvoyant 
schedule: intuitively, if p is dominated at t, it makes no sense to transmit it at t. Formally, 
(wlog) dominated packets are not included in the clairvoyant schedule, as stated in the 
following. 

Fact 2.3. For any fixed input sequence, time step t, and oblivious schedule Ot, there is a 
clairvoyant schedule such that Pi {j : rj < t} ^ O^. 

Proof. This is a standard alternating path argument about matchings. If you are unfamiliar 
with these concepts, refer to a book by A. Schrijver [13J for example. 

Let Ot be the oblivious schedule and Ct be any clairvoyant schedule. Treat both as 
matchings in the schedulability graph and consider their symmetric difference Ct ® Ot- 
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Consider any job j G Ct\ Ot such that rj < t. It is an endpoint of an alternating path P 
in Ct®Ot- Note that ah the jobs on P are aheady pending at time t: this is certainly true 
about j, and all the successive jobs belong to Ot, so they are pending as well. 

First we prove that P has even length, i.e., it ends in a node corresponding to a job. 
Assume for contradiction that P's length is odd, and that P ends in a node corresponding 
to a timestep t' . Note that no job is assigned to t' in Ot- Then ® P is a feasible schedule 
that, treated as a set, satisfies Ot ^ Ot ® P and j G Of © P. This contradicts optimality 
of Ot- See Figure [2a] for illustration. 

Thus P has even length and ends with a job j' G Ot\Ct- By optimality of both Ot 
and Ct, Wj = Wj' holds. Thus Cj © P is an optimal feasible schedule: in terms of sets the 
only difference between Ct and Cf © P is that j has been replaced by j' , a job of the same 
weight. See Figure [2b] for illustration. 




''t' 




(a) P cannot have odd 
length: in such case the as- 
signment of jobs on P in Ot 
could be changed to match 
the strictly better assign- 
ment of Ct- 



(b) P has even length: now the as- 
signment of jobs on P in Ct can be 
changed to match the assignment of 
Ot so that the value of A drops. 



Figure 2. The alternating path P. Packets are represented by discs, time 
steps by squares. Dashed lines represent Ct, solid lines represent Ot- 



Applying such changes iteratively transforms Ct to a clairvoyant schedule as an- 
nounced. To observe that a finite number of iterations suffices, define A{S) := \Sr]{j : rj < 
t}\Ot\ for any schedule S- It follows that A(Cj © P) = A(Cj) — 1. Since A is non-negative 
and its value drops by one with each iteration, is obtained in a finite number of steps. ■ 

Definition 2.4. We say that a clairvoyant schedule Ct conforms with an oblivious sched- 
ule Ot if Ct is a ^-schedule, Ct n {j : rj < t} <^ Ot, and for all i G Ot such that i<\j = Ct{t), 
Wi < Wj holds. 

Fact 2.5. For every oblivious schedule Ot there is a conforming clairvoyant schedule C^ . 

Proof. Let Ct be a clairvoyant schedule such that Ctri{j: rj < t} C Ot; Fact 12.31 guarantees 
its existence. Let Cj* be the schedule obtained from Ct by first turning it into a ^-schedule 
Cj- and then replacing j = C't{t) with a ^-minimal non-dominated packet j' of the same 
weight. 

If j' = i) then Ct = C't, and thus it is a clairvoyant ^-schedule. Assume j' ^ j, i.e., 
/ <] j- Then / ^ C't, since C't is a ^-schedule. Thus is feasible as we replace C^'s very 
first packet by another pending packet which was not included in Ct- Observe that Ct is 
indeed a clairvoyant ^-schedule: optimality follows from Wji = Wj, while consistency with 
< follows from j' < j. 
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It remains to prove that for every i G Ot such that i < j' , Wi < Wji = Wj holds. Note 
that i ^ as is a ^-schedule, and that Wi 7^ wj' = Wj holds by the choice of j' . 
Assume for contradiction that Wi > wj . Then Cj* with j replaced by i is a feasible schedule 
contradicting optimality of Cj*. ■ 

Now we inspect some properties of conforming schedules. 

Fact 2.6. Let Ct be a clairvoyant schedule conforming with an oblivious schedule Of. If 
i,j G Ot, Wi < Wj and di < dj (or, equivalently Wi < Wj and i <\ j), and i £ Ct, then also 
j e Ct. 

Proof. Assume for contradiction that j ^ Ct- Then Ct with i replaced by j is a feasible 
schedule contradicting optimality of C^. ■ 

Lemma 2.7. Let Ct be a clairvoyant schedule conforming with an oblivious schedule Ot. 
Suppose that e = Ot{t) ^ Ct. Then there is a clairvoyant schedule C^ obtained from Ct by 
reordering of packets such that C^{t) = h. 

Proof. Let j = Ct{t) ^ h and let Ot = pi,p2, . . . ,Ps. Observe that h £ Ct hy Fact 12.61 So 
in particular e = pi, j = pk, and h = pi for some 1 < k < I < s. Let di denote the deadline 
of Pi for 1 < i < s. Since Ot is feasible in the absence of future arrivals, di > t + i for 
i = l,...,s. 

Recall that pk,Pi € Ct and that there can be some further packets p £ Ct such that 
Pk <\p <\ pi; some of these packets may be not pending yet. We construct a schedule Cj by 
reordering Ct. Precisely, we put all the packets from Ct that are not yet pending at t after 
all the packets from Ct that are already pending, keeping the order between the pending 
packets and between those not yet pending. By the agreeable deadlines property, this is an 
earliest deadline first order, so Cj is a clairvoyant schedule. 

As e = pi ^ Ct and di > t + i for z = 1, . . . , s, all the packets x G Cj preceding h 
in Ct (i.e., x £ Cj- such that r^ < t and x <\ pi = h) have slack in Cj, i.e., each of them 
could also be scheduled one step later. Hence h = pi can be moved to the very front of C^ 
while keeping its feasibility, i.e., C^ = pk,Pk' , . . . ,Pi' ,Pi can be transformed to a clairvoyant 
schedule C^ = pi,pk,Pk' , . . . , Pi' • The reordering is illustrated in Figure [3l ■ 

Pl = e P2 
Ot o ♦ 

c: ^ t 

pi = h P2 

Figure 3. Construction of the schedule Q*. Packets are represented by 
circles: the ones included in Ct (C*) are filled, the remaining ones are hollow. 



P3 Pa Pb P6 P7 Pi-2 Pi-i Pi = h 

« « o • o O - 

t I / • 

P3 P4 P6 Vl-1 
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3. Algorithms and their analyzes 

3.1. The Algorithms 

The algorithm MG [12] works as follows: at the beginning of each step t it considers the 
packets in the buffer and the newly arrived packets, and calculates Ot- Then MG identifies 
the packets e and h. If (pWe > w^, MG sends e. Otherwise, it sends the ^-minimal packet 
/ such that Wf > cpWe and (pWf > Wh; the latter exists as h itself is a valid candidate. Our 
deterministic algorithm MG' does exactly the same with one exception: if (pWe < Wh, it 
sends h rather than /. Our randomized algorithm RG also works in a similar fashion: it 
transmits e with probability — and h with the remaining probability. For completeness, 
we provide pseudo-codes of all three algorithms in Figure H) 

MG (step t) 

Ot ^ oblivious schedule at t 

e the ^-minimal packet from Ot 

h ^ the ^-minimal of all the heaviest packets from Ot 

if (j)We > Wh 

then transmit e 

else / the ^-minimal of all j G Ot s.t. wj > (pWe and (pwj > Wh 
transmit / 

MG' (step t) 

Ot ^ oblivious schedule at t 

e the ^-minimal packet from Ot 

h the ^-minimal of all the heaviest packets from Ot 

if (f)We > Wh 

then transmit e 
else transmit h 

RG (step t) 

Ot ^ oblivious schedule at t 

e ^ the ^-minimal packet from Ot 

h ^ the ^-minimal of all the heaviest packets from Ot 

transmit e with probability ^ and h with probability 1 — ^ 

Figure 4. The three algorithms 



3.2. Analysis Idea 

The analysis of Li et al. [12] uses the following idea: in each step, after both MG and 
Adv transmitted their packets, modify Adv's buffer in such a way that it remains the 
same as MG's and that this change can only improve Adv's gain, both in this step and 
in the future. Sometimes Adv's schedule is also modified to achieve this goal, specifically, 
the packets in it may be reordered, and Adv may sometimes be allowed to transmit two 
packets in a single step. It is proved that in each such step the ratio of Adv's to MG's gain 
is at most (p. As was already noticed by Li et al. [12], this is essentially a potential function 
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argument. To simplify the analysis, it is assumed (wlog) that Adv transmits its packets in 
the < order. 

Our analysis follows the outline of the one by Li et al., but we make it more formal. 
Observe that there may be multiple clairvoyant schedules, and that Adv can transmit Ct{t) 
at every step t, where Ct is a clairvoyant schedule chosen arbitrarily in step t. As our 
algorithms MG' and RG determine the oblivious schedule Of at each step, we assume that 
every Ct is a clairvoyant schedule conforming with Ot- 

There is one exception though. Sometimes, when a reordering in Ct does not hinder 
Adv's performance (taking future arrivals into account), we "force" Adv to follow the 
reordered schedule. This is the situation described in Lemma 12.71 when e ^ Ct, there is 
a clairvoyant schedule such that h = Ct{t). In such case we may assume that Adv 
follows C* rather than Ct, i.e., that it transmits h at t. Indeed, we make that assumption 
whenever our algorithm (either MG' or RG) transmits h at such step: then Adv and MG' 
(RG) transmit the same packet, which greatly simplifies the analysis. 

Our analysis of MG' is essentially the same as the original analysis of MG by Li et al. [12] , 
but lacks one case which is superfluous due to our modiflcation. As our algorithm MG' 
always transmits either e or h, and the packet j that Adv transmits always satisfles j ^ h 
by definition of the clairvoyant schedule conforming with Ot, the case which MG transmits 
/ such that e < / < j does not occur to MG'. The same observation applies to RG, whose 
analysis also follows the ideas of Li et al. 

3.3. Analysis of the Deterministic Algorithm 

We analyze this algorithm as mentioned before, i.e., assuming (wlog) that at every step 
t Adv transmits Ct{t), where Ct is a clairvoyant schedule conforming with Ot- 

Theorem 3.1. MG' is (j)- competitive on sequences with agreeable deadlines. 

Proof. Note that whenever MG' and Adv transmit the same packet, clearly their gains 
are the same, as are their buffers right after such step. In particular this happens when 
e = h as then MG' transmits e = h and Adv does the same: in such case h is both the 
heaviest packet and the <-minimal non-dominated packet, so h = Ct{t) by definition of the 
clairvoyant schedule conforming with Ot. 

In what follows we inspect the three remaining cases. 

(f)We > Wh'- MG' transmits e. Adv transmits j ^ e.. To make the buffers of MG' and 
Adv identical right after this step, we replace e in Adv's buffer by j. This is advantageous 
for Adv as d^ > de and Wj > We follows from e < j and the definition of a clairvoyant 
schedule conforming with Ot. As cpWe > Wh, the ratio of gains is 

We We 
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(f)We < Wh'- MG' transmits h. Adv transmits e.. Note that Adv's clairvoyant schedule 
from this step contains h by Fact 12.61 We let Adv transmit both e and h in this step 
and keep e in its buffer, making it identical to the buffer of MG'. Keeping e, as well as 
transmitting two packets at a time is clearly advantageous for Adv. As (pWe < Wh, the ratio 
of gains is 

<- + ! = (?!) . 

wh 4> 

4>We < Wfi'- MG' transmits h. Adv transmits j 7^ e.. Note that j < h: by definition of 
the clairvoyant schedule conforming with Ot, for every i £ Ot such that i<j, Wi < Wj holds. 

There are two cases: either j = h, or Wj < Wh and dj < dh- In the former one both 
players do the same and end up with identical buffers. Thus we focus on the latter case. 
Fact 12.61 implies that h £ Ct- By Lemma 12.71 Ct remains feasible when h is moved to its 
very beginning. Hence we assume that Adv transmits h in the current step. As this is the 
packet that MG' sends, the gains of Adv and MG' are the same and no changes need be 
made to Adv's buffer. ■ 



3.4. Analysis of the Randomized Algorithm 

We analyze this algorithm as mentioned before, i.e., assuming (wlog) that at every step 
t Adv transmits Ct{t), where Ct is a clairvoyant schedule conforming with Ot- 

Theorem 3.2. RG is ^-competitive against oblivious adversary on sequences with agreeable 
deadlines. 

Proof. Observe that if e = /i, then RG transmits e = h and Adv does the same: as in such 
case h is both the heaviest packet and the ^-minimal non-dominated packet, h = Ct{t) by 
definition of the clairvoyant schedule conforming with Of. In such case the gains of RG 
and Adv are clearly the same, as are their buffers right after step t. Thus we assume e ^ h 
from now on. 

Let us first bound the algorithm's expected gain in one step. It equals 

Grg = We + [l ] - Wh 

Wh \ WhJ 



[w, 



2 



— - WeWh + wl) 

Wh 

1 f( «^h\2 3 2 

wh[r^-^) +4^^^ 

> Iwh . (3.1) 

Now we describe the changes to Adv's scheduling policy and buffer in the given step. 
These make Adv's RG's buffers identical, and, furthermore, make the expected gain of the 
adversary equal exactly Wh. This, together with (13. ip yields the desired bound. To this end 
we consider cases depending on Adv's choice. 
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(1) Adv transmits e. Note that Adv's clairvoyant schedule from this step contains h 
by Fact [M 

If RG transmits e, which it does with probability both players gain We and 
no changes are required. 

Otherwise RG transmits h, and we let Adv transmit both e and h in this step 
and keep e in its buffer, making it identical to RG's buffer. Keeping e, as well as 
transmitting two packets at a time is clearly advantageous for Adv. 

Thus in this case the adversary's expected gain is 

^ it^e f We\ , . , . 

^ADV = We^\\ \{We^Wh)=We^[Wh-We) = Wh ■ 

Wh \ WhJ 

(2) Adv transmits j ^ e. Note that j < h: by definition of the clairvoyant schedule 
conforming with Oj, for every i G Ot such that i < j, Wi < wj holds. 

If RG sends e, which it does with probability — , we simply replace e in Adv's 
buffer by j. This is advantageous for Adv as wj > We and dj > de follow from e <ij 
and the definition of the clairvoyant schedule conforming with Ot- 

Otherwise RG sends h, and we claim that (wlog) Adv does the same. Suppose 
that j 7^ h, which implies that wj < Wh and dj < d^. Then /i € Cf, by Fact 12.61 
Thus, by Lemma 12. 7| Ct remains feasible when h is moved to its very beginning. 
Hence we assume that Adv transmits h in the current step. No further changes 
need be made to Adv's buffer as RG also sends h. 

Thus in this case the adversary's expected gain is Wh. ■ 



4. Conclusion and Open Problems 

We have shown that, as long as the adversary is oblivious, the ideas of Li et al. [12 

4 
3 



can be applied to randomized algorithms, and devised a ^-competitive algorithm this way. 



However, the gap between the | lower bound and our | upper bound remains. 

Some parts of our analysis hold even in the adaptive adversary model [8j. On the 
other hand, other parts do not extend to adaptive adversary model, since in general such 
adversary's schedule is a random variable depending on the algorithm's random choices. 
Therefore it is not possible to assume that this "schedule" is ordered by deadlines, let alone 
perform reordering like the one in proof of Lemma 12.71 

This makes bridging either the [|, |] gap in the oblivious adversary model, or the 

gap in the adaptive adversary model all the more interesting. 



4 _e_ 
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